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(54) Electronic mall system 

(57) An electronic mail system connected to a net- 
work includes a section for converting an image of a 
document surface into con-esponding document image 
data, and a section for compressing the document 
image data into compression-resultant image data The 
electronic mail system also includes a section for con- 
verting the conpression-resuttant image data into cor- 
responding image data of a given electronic-mail 
format a section for receiving information of an elec- 
tronic-mail destination address, and a section for trans- 
mitting the image data of the electronic-mail format 
toward the electronic-mail destination address via the 
network. The electronic mail system may further include 
a secUon for receiving image data in an electronic mail, 
a section for converting the received image data into 
conesponding received image data of a given facsimile 
format a section for expanding the received image data 
of the facsimile format into expansion-resultant image 
data, and a sectk)n for printing the expansion-resultant 
image data. 
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Description 

BACKGROUND OF THE INVENfTION 
Retd of th e Invention 

This invention relates to an electronic mail system 
which can handle image information. 

Description of the Prior Art 

f Japanese pubfishedimexanvned patent application 
;^r1723^;^tis^ facsimile apparatus which 

^^hcbjdesian interlace lor connection witii a conrputer 
^ network, and a controller for enabling an electronic mail 
10 be ou^putted to the computer network via the inter- 
iace. The facsimile apparatus is also connected to a tel- 
ephone line to receive and output image information 
from and to the telephone line. In Japanese application 
2-1 72348, the electronic mail outputted to the computer 
network represents a facsimile transmission result 
report or a facsimile reception result report rather than 
image information. 

United States Patent 5.479.411 discloses that 
voice, facsimile. arxJ electronic mail messaging is inte- 
grated in a system which converts e-mail messages into 
voice-arxl-fax messages. An e-mail message is parsed 
into voiceaWe, prose, segments and non-voiceaWe. 
non-prose, segments. Prose segments are converted 
into voice message segments via text-to-speech facili- 
ties. Each non-prose segment is converted into a fax 
segment. Voice pointers to fax segments are inserted 
into the voice message, in places corresporvJing to the 
non-prose segments in the e-mail message. The voice 
file and fax tile are then stored for siAisequerrt delivery 
of the message as an inte^Bted voice-and-fax mes- 
sage. Conversion of integrated voice-and-fax messages 
into e-mail messages is likewise envisioned. 

SUMMARY OF THE iNVgNfTinM 

It is an object of this invention to provide an 
improved electiwiic mail system. 

A first aspect of this invention provides an electronic 
mall system connected to a network which comprises 
ineans tor converting an image of a document surface 
into corresponding dcxument image data; means 
compressing the document image data into conpres- 
sion-resultant image data: means for converting the 
compression-resunant image data into corresponding 
image data of a given electo-onic-mall format; means for 
receiving information of an electronic-mall destination 
address; and means for transmitting tiie image data of 
the electronic-mail format toward the electronic-mall 
destination address via the network 

A second aspect of this invention is based on the 
first aspect thereof, and provides an electronic mail sys- 
tem further comprising means for receiving image data 
in an electronic mail; means for converting the received 
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image data into corresponding received image data of a 
given facsimile format; means for expanding the 
received image data of the facsimile format into expan- 
sion-resultant image data; and means tor printing the 

5 expansiorvresuttant image data. 

A third aspect of this invention is t>a&ed on the first 
aspect thereof, and provides an electronic mail system 
further comprising means for transmitting character 
code data by an electronic mail. 

10 A fourth aspect of ttiis invention is based on the first 
aspect thereof, and provides €m-elecbonic mail system 
wherein the destination-address receiving means oom- 
prises means for recognizing an electronic-mail destirta* 
tion address in a given position of the inrtage data. 

IS A fiftii aspect of this invention is based on the first 
aspect tiiereof. arKJ provides an electronic mail system 
further comprising means for receiving information of an 
electronic-mail sender address as information of an 
electronic-mail source address, and means for, in cases 

20 where a transmission failure occurs, informing the elec- 
tronic-mail source address of the t-ansmission failure. 

A sixth aspect of this invention is t>ased on the first 
aspect thereof, and provides an electronic mail system 
further comprising means for receiving audio data. 

25 means for integrating the audio data and the image data 
into integration-resultant data, and means for transmit- 
ting the integration-resultant data as a single electronic 
mail. 

A seventh aspect of this invention is based on the 

30 first aspect thereof, and provides an eiectix)nic mail sys- 
tem further comprising means for receiving nxiving-pic- 
ture data, means for integrating the movirig-picture data 
and tile image data into integration-resultant data, and 
means for transrrritting the integration-resultant data as 

35 a single electronic mail. 

An eighth aspect of ttiis invention is based on the 
third aspect tiiereof, and provides an electi-onic mail 
system further comprising means for analyzing a char- 
acter sequence in a given position of received character 

40 code data, and means for implementing a process in 
response to a result of said analyzing. 

A ninth aspect of this invention is based on the 
eightii aspect thereof, and provides an electronic mail 
system further comprising means for. in cases where 

45 the analyzed character sequ^ice indicates registration 
of a destination mail address, registering serxJer ID 
information in a sut>sequent character sequence and a 
plurality of destination maa addresses vvhile providing a 
con^espondence relation between the sender ID Infor- 

50 mation ajnd the destination mall addresses, and means 
for, in cases where sender ID information is received 
during mall transmissfon and the sender ID information 
is equal to the registered sender ID information, indicat- 
ing the corresponding destination m£Ul addresses and 

55 selecting a necessary destination from among ttie des- 
tination mail addresses. 

A tenth aspect of this invention is based on the 
eighth aspect thereof, and provides an electronic mail 
system further comprising means for. in cases where 
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^^ address while P'.^'S.^Sn^Sthe source ma« 
between the sender '"^^"^^e sender ID infor- 
address.andme^star^mca^'J^^^^ 

'^^^iTL^io the registered sender 
rnSr^^^-'-rres^'^sourcen.. 

address as a source. based on the 

. — »*%oer»«ci of this invention IS oasww 
Anele«nttia^«tn electronic mail 

„inth aspect ^'^^f;^ ^.^^tor. in cases where 
^'^ilSSt rlS^duriitg mail transmis- 

^°ti^^ «*"^^^Ta 
sionandthesenowi^ intonnation of a 

source mail adof^^ «♦ a mall as a source. 

^^^^^a^J provides an electronic mail 
second aspect for providing a con- 

system further «>^«'"9 ""^n^s for selectively 
nSon to a telephone hne and ^ tel- 

transmittingtheimage cla^^^^ 

ephone line ^'"^^^l^c^yp^oceiure. 

the network a**"^!^^ ^2,^ ^on is based on the 
AtNrteenth aspect of*««v^o electronic mail 
twelfth aspect thereof . P^^^y^ing a char- 
system further ^"^J^^^^^er code 
acter sequence jn ^ 9J^^ f^j, tor. in cases 

data in a received el^»«c "^^ .^^es wait 
where the analyzed '^^^J^^^ a notice elec- 

'^^^^TSS^n'a^eJS-t character 
tronic-mail address in image data .s 

sequence, meare ^ telephone line 

received va the .'^^''^^^^'^^ 
according to a S^ng an elec- 

tronic-mail address «re«,gn.«d^^^^ 
tronic mail representetve rta receptK>n 

notice electronic-mail .,^onisi»sedonthe 
AfourteenthaaP«:tof tl^"J^^'^„j^ ^i, 

twelfth aspect thereolaj^ J^s^rai^'V^ing a first 
system further «>^9"^25o?rt a header of 
chararter sequence in a gwenp^tiw^ means for. in 

cases ^«'^*'*J^5So^^Sgnizing a second 
cates tacsimile !^ of the header 

character sequence ma gwenp^^ ^ 

except Ihe ^^^^^LSJaS^a received image 
nun*)er. andtneans to wnw^^ connection to 
datatowa«l1he,lac8««temr^^ 
tt,e telephone Bne^noto^te»« 

A fifteenth ^^^'t^^^JSectronic mail sys- 

a country 

tem further «>mpr«m9 "^e^^^ ^ destination 
saving a <^^JJ^J^on of standard 



the «»e"t'"^jL tt,is invention is t«sed on the 
^ ^'''^^^^SS arS provides an electronic rna.1 
second aspect «^«^«°L*^^eans for registering a p«u- 
system further «>"]P2 means tor storing 

rality of «'«*°";^-^^^?^^ed by an electron^ 
and •^^"^ '"^f ^^ic-mail addresses, means 
mail for each o« f ,especlive electronic-mail 

^***^i^S^«5.provides an electronic 
thesirteenlha^*«^J«~ tor generating 

asnect of this invention is based on 

the second aspect *^_ea^ tor. in cases 

mail system further com^"fl^ Emitting a 
^ere afir^ ^^^rJi^ed deception of the 
second e'«^r;i:^ l^S^^onic-mail address 
first electronic mail to a seno 

.elated to me first ele^^ "^J^ 'mention is based on 

the second aspect t^«[!°V;^ tor writing recep- 
mail system further ««m^9 ^ ^^^„j, 

„^torprovidingac«re^^ ^^^^ 

a sender means 
electronic mail and reoef«»i iniormation is 

A twentieth aspett "^",^66 an electronic mail 
3econd aspect ^^^^^^^S^^On cases where 
system turther «K^ng n^-.^ 

transm«s.on of a ^^^^^at^ansmtesioniailure. and 

the first aspect *~ ^ ^ receiving charac- 

svstem further compnsing means « 
SridedatabyanelectnMi.cma.1. 
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*-?s^raTj:Sn^^°'^^^^^ 

,^,.ng a CPU^^ V„ ^ ^ electronic mail sys- 

^J.'^^stSreatxx.iment of tNs inven- 
tem according to a secorw ^ 
'°" F.g 4 is a flowchart of a segment of a program for 

controlling a CP UJ" "^J; of an electronic mail sys- 
tem ^^o^r^fng^ Sf«S---^-"^ °' ^^^^ 
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Fig. 6 is a flowchart of a segment of a program for 
controlling a CPU in Fig. 5. 

Fig. 7 is a block diagram of an electronic mail sys- 
tem according to a fourth embodiment of this invention. 

Ftg. 8 is a flowchart of a segment of a program for 
corrtroiling a CPU in Fig. 7. 

Rg. 9 is a block diagram of an electronic mail sys- 
tem according to a fifth entxxJinient of this invention. 

Fig. lOis afk^M^chartof asegmentof aprogrsunfor 
controlling a CPU in Fig. 9. 

HRq^I 1 tkock cfiagram of an electronic mail sys- 
; tern 300onlingteiQ 8bcth^enrtfxxlinrient of this invention. 
^Ij^i^iz^B^fi^^ of a f frst segment of a program 

"Rb^S'is-a fiow^^ segment of the 

program for contrdltng the CPU in Fig. 11 . 

Fig. 14 is a bk>ck cfiagram of an electronic mail sys- 
tem according to a seventh embodiment of this inven- 
tion. 

Fig. 15 is a flowchart of a segment of a program for 
controlling a CPU in Fig. 14. 

Fig. 16 is a block diagram of an electronic mail sys- 
tem according to an eighth embodiment of this inven- 
tion. 

Fig. 17tsadiagramof apartof an example of an e- 
mail in a given format. 

Fig. 181s a block dia^m of an electronic mail sys- 
tem according to a ninth embocfiment of this invention. 

Fig. 1 9 is a flowchart of afirst segment of a program 
for controllHlg a CPU in Fig. 18. 

Fig. 20':is a flowchart of a second segment of the 
program foi'icontrollir^ the CPU in Rg. 18. 

Fig. 211s a bk>ck dia^am of an electronic mail sys- 
tem according to a tenth embodintent of this invention. 

Fig. 22 is a flowchart of a first segment of a program 
for controltihjg a CPU in Fig. 21 , 

Fig. 23* a flowchart of a second segment of the 
progrsun for controlling the CPU in Fig. 21 . 

Ftg. 24 is a bk>ck diagram of an electronic mail sys- 
tem according to a twelfth embodiment of this invention. 

Fig. 25 is a flowchart of a segment of a program for 
controlling a CPU in Fig. 24. 

Fig. 26 IS a flowchart of a segment of a program for 
controliing a CPU in an electronic mail system accord- 
ing to a thirteenth embodimerTt of this invention. 

Ftg. 27 is afkywchart of a segment of a program for 
controlling a CPU in an electronic tnaM system accord- 
ing to a fourteenth embodiment of this inventkKi. 

Fig. 28 is a bkx:k cfiagram of cm electrcmic mail sys- 
tem according to a fifteenth enrtfxxliment of IWs inven- 
tion. 

Fig. 29 is a flowchart of a segmmt of a program for 
contrc3lltng a CPU in Fig. 28. 

Fig. 30 is a flowchart df a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to a sixteenth embcxliment of this invention. 

Fig. 31 is a flc3wchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to an eighteenth embodiment of this invention. 



Fig. 32 is a flowchart of a segment of a program for 
controlling a CPU in an electronic mail system accord- 
ing to a nineteenth embcxjiment of this invention. 

Fig. 33 is a flowchart of a segmerrt of a program for 
5 controlltng a CPU in an electronic mail system accord- 
ing to a twentieth enrbodiment of this invention. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 
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First Emtxriiment 



With reference to Fig. 1 . an electronic mail system 
includes a CPU 1 . a ROM 2. a RAM 3. a storage unit 4. 
75 a format converter 5. a scanner 6. an operation panel 7, 
a data compressor 8. and a LAN (local area network) 
controller 9 which are electrically connected via a bus 
line. 

The CPU 1 operates in acxxKdartce with a program 

20 Stored in the ROM 2. The CPU 1 provides a wrk area 
in the RAM 3. and accesses arxf uses the work area 
during signal prcx;essir^. The stcxage unit 4 includes, 
for example, a hard disk device whic^h is used in storing 
data including compresston-resuttant image data of a 

25 facsiiTBle format The format converter 5 changes com- 
pression-resultant image data of the facsimile format 
into correspofxltng image data of the e-mail (electronic 
mail) format The scanner 6 converts an image of. for 
example, a document sheet surface into cxxresponding 

30 t>inary image data (corresporvitng t>Mevel image data) . 
The operation panel 7 fias a key board, a start button, 
and other buttons. Infoi- mat kyi of the destination orihe 
address of an e-mail to be transmitted can t>e trputted 
into the electronic mail system t>y operating the key 

35 tx>arcl on the operation panel 7. The scanner 6 c^n t>e 
activated by operating the start button on the operation 
panel 7. The data compressor 8 serves to compress 
binary image data (bi-level image ciata) wtiich is gener- 
ated by the scanner 6. The LAN corttrofler 9 includes a 

40 LAN interface. 

The LAN corrtroller 9 is cxvinected via a LAN to an 
e-mail computer 9A. The e-mail computer 9A is corv 
nected to an e-mail network such as the Internet 

As previously described, the CPU 1 operates in 

45 accordance witt a program stored in the ROM 2. Ftg. 2 
is a flowchart of a segment of the program. In the case 
where the transrressk)n of infomnatXKi en a document 
sheet Is rec^uired. the sheet is placed in the scanner 6 
and information of a ttestred ctestination is inputted via 

50 the operation panel 7. Further, the start button on the 
operation panel 7 is ciepressed. 

With reference to Fig. 2, a first step S1 in the pro- 
gram segment decides whether or not information of pe 
destination or the ackfress of an e-mail to t>e transnvtted 

55 has been inputted via the operation panel 7. In acidition. 
tiie step Si deckles whether or not the start txrtton on 
the operation panel 7 has been depressed. In the case 
where information of the destination of an e-mail to be 
transmitted has been inputted and the start button on 
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the operation panel 7 has beWSepressed. the program 
advances from the step S1 to a step S2. ^^^^^^ 
program repeats the step SI. Thus. the^^S^ «^ 
thrreception of an e^l destination and the depres- 
sion of the start Ixitton. 

The step S2 activates the scanner 6 so that an 
image of the surtace of a document sheet in thescame^ 
6 is converted by the scanner 6 -f* ^"^^f^? 
binary image data (corresponding b-iev^ "^^^l 
A st^ S3 following the step S2 transfers the b«wy 
rma^daia from the scanner 6 to the data compre«« 
8^.1hestep SSBCtivateslhedata «jrpr^8 « 

that the binary image data is compressed by d»m» 
?Sto conpiessionHesultant image dataof a gjven fee- 
Lae lom«t. Further, the step S3J™^.J««^ 
pression^esuttant image data of Ihe 
from Ihe data oorrpressor 8 to the storage 4 tato^ 
storing the conpression-resultent image data of thefec- 
Se format into the storage unit 4. In ^^^.'^ 
the fransmission of information on a plurality of docu 
ment sheets (that is. a plurality of pages) e r^uired. the 
document sheets are sequentially scanned by the 
device 6 and the compression-resultant ™e data 
the facsimile format is stored into the storage unrt 4 as a 

single file having a pliH-ality of pages. 

A step 84 following the step S3 transfers the rom- 
pression-resultant image data of the facsimile format 
irom the storage unit 4 to the format «>'^erter S^The 
step S4 activates the format converter 5 so that Jie 
comprksion-resultant image data of the facsimile tor- 
mat is converted by the device 5 into •^'W^d-jg 
image data of the e-mail formal In addition, the step S4 
t^nsfers the image data of the e-mail fom»t from the 
format converter 5 to the storage unit 4 before stonng 
the image data of the e-mail format into the storage unrt 

* A step S5 subsequent to the step S4 transfers the 
image data of the e-mail format from the storage unit 4 
to the LAN controller 9. The step S5 activates the LAN 
controller 9 so that the image data of the e-n«|I forma^ 
is further transferred from the LMM controller 9 to the e- 
mail coTTputer 9A. The image data of the e^nal format, 
that is. an entail is transmitted from the ^'^l 
ter 9Atothedeslination viathe e-mail network 9B. After 
the step S5. the current execution cyde of the program 

T^.SlSe data generated by the scanner 6 is of 
the binary type or Ihe bi^««l "^ 7*1^^^^ 
resultam image <la!a of the tacsimPe 
generated by the data compressor 8 © also of the binary 
^ or thebi^evel type. The forinat cofiverter 5 aJOC«- 

sively encodes pieces of the ""^P^f^^^^-j^f"!^^! 
simile image data into «>'^«ponding 7-b,t rtar^^er 
code words respectively. The T-brt character code 
words compose text-encoded image data. Thus^ for- 
mat converter 5 changes the compression-resultant f^ 
simile image data into the corresponding text-encoded 
image data. The formal converter 5 adds a header of a 
given format to the text-encoded image data, thereby 
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completing th^ge data of the e-^^^il format The 
header include?&mation of the destnation^ intoma- 
tion of a source address, information of the data torn«t^ 
and information of the manner of 
image data into the character code words. The format 
r^-^Tthe header and the manner of '=0^'^^ 
from the image data into the character code w^n^a^ 
in confonrtty with the Internet e-main starxiards 
r^^STa* MIME (Multipurpose Internet Ma.1 Exten- 

sions). 



Fia3showsasecond embodiment of this invention 
which is similar to the embodiment of and 2 

except for an additional arrangement descnbed herein- 

^^With reference to Fig. 3. an electronic mail system 
includes a CPU 1 . a BOM 2. a RAM 3. a storage unit 4. 
a format converter 5. a scanner 6. an operation panel 7. 
aSta compressor/expander 8A. a LAN (local area net- 
work) confroller 9. an inverse format "-^^^f'JO- ^'J^ 
printer 11 ^ich are electrically connected via a bus 
JnrThe inverse format converter 10 changes .n«^ 
data of the e-mail format into ""'^^^'"S 
of a given facsimile fonnat. The data canpres 
sor/ex^nder8Areplacesthedatacompressor8.n Fig. 
1 The data conpressor/expander 8A serves to com- 
pressbinary image data (bi4e.elirmged«a)^^ 
by the scanner €. In addition.Jhe ^^^^ 
sor/expander fiA serves to ^expand image data of the 
lacJrrtleJ^mat into expansion^esultant binary .m^e 
data (expansion-resultant A)i-tevel image iteta). The 
printer 1 1 senses toprint out expansfon-resultant binary 
35 image^*te^^ ^ ^^^^ accordance with a program 
stored in the ROM 2. Fig. 4 is a f la*.ctert of a s^i^nt 
of the program. With reference to Fig^. a '"rst st^ Si i 
in the program segment decides whefrier or nrt date of 
^ thee-mailtormathasbeenreceivedbythelANconfrol- 
ler 9. in the case where data of the e-mail fonirat 1^ 
been received, the step S1 1 transfers the recew^<^^ 
of the e-mail fonrot to the storage unrt 4. sl^i 1 
controls the storage unit 4 so that the rece«.ed data erf 
45 the e-mail format is Stored into the Storage unrt 4Jn^ 
case «»here data of the -e-mail format has not yet been 
^^Sl^he prog«m 'epeatsij^estep S11. Thjj^e 
step S1l^»waits Ihe reception of data of the ^nnail lor 

so "^A step S12A following the step Sli feekJes 
Whether or.not the received data ^^^l^';^'^ 
agrees^imagedala ofthe e^l 
torelatedinfonnation in the header of the rec«ved date 
of the entteil formaL When the received date agrees 
55 v«th image date, the program advances fromtfie^^ 
S12A to a step S12B. When the received data dittos 
from image date, the program ad>^fro"^step 
S12A to a step S12C. The step S12B transfers the 
received date of the e-mail format from the storage unit 
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4 to the inverse format converter 10, The step S12B 
activates the inverse format converter 10 so that the 
received data of the e-mail format is converted by the 
device 10 into corresponding image data of a given fac- 
simile format The step 12C controls the LAN contro«ler 5 
9 so that a responsive e-mail representing an error will 
be transmitted to the source concerntng the received 
data of the e-nruul format After the step S12C, the cur- 
rent-execution cyde of the program segment ends. 

A step S13 following the st^ S12B transfers the 10 
image data of the facsimile fomnat from the inverse for- 
mat converter 10 to the data compressor/expander 3A 
The7|^tej^"Bl3 ac^^ 

8A ^¥tt)at;1he of the facsimile fonnat is 

-expanded by the device 8A into expansion-resultant is 
binary image data (ejqaansion-resultant bi-leve! image 
data). Further, the step S13 transfers the expansion- 
resultant binary image data from the data compres- 
sor/expemder 8A to the storage unit 4 before storing the 
expansion-restdtant binary image data into the storage 20 
unit 4. 

A step S14 subsequent to the step S13 transfers 
the expansion-resultant binary image data from the 
storage unit 4 to the printer 1 1 . The step SI 4 activates 
the printer ?1 1 so that the expansion-resultant t>inary 55 
image datais visualized or printed out by the device 1 1 . 
After the step S14. the current execution cyde of the 
program segment ends. 

As previously descrtoed. the inverse fonnat con- 
verter 1 0 changes the received data of the e-mail format 30 
into the conesponding image data of the facsimHe for- 
mat. Specifically, the inverse format converter 10 
extracts text-encoded image data from the received 
data of the e-mail format. Then, the inverse format con- 
verter 1 0 changes the text-encoded image data into cor- 35 
respondingbinary (bi-level) image data of the facsimile 
format i: 



Third Embodiment 
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Fig. 5 shows a third emtxxJiment of this invention 
which is similar to the embodiment of Rgs. 3 and 4 
except for an additional arrangement described herein- 
after. 

With reference 10 Fig. 5, an electronic mail system 45 
indudesa CPU 1 ROM 2. a RAM 3. a storage unit 4. 
a format converter:5.a scanner.6. an operation panel 7, 
a data oompressor/expander 8A, a LAN (local area net- 
work) controller 9. «in inverse format converter 10, a 
prnrter 11. and alont memory 12 whichare electrically so 
connected via a txjs line. The font mmx>ry 12 includes, 
for example, a ROM which stores font data providing the 
relation between character code data and image data 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 6 is a flowchart of a segment ss 
of the program. With reference to Rg. 6. a first step S21 
in the program segment decides whether or not data of 
the e-mail format has been received by the LAN control- 
ler 9- This decision is to wart the reception of data of the 



e-mail format. In the case where data of the e-mail for- 
mat has been received, the step S21 decides whether 
or not the received data of the e-mail format agrees with 
character code data by refen-ing to the data format infor- 
mation in the header of the received data of the e-mail 
fonnat. According to the MIME standards, the data for- 
mat information foHows the information "content-type*", 
and denotes 1ext/|plain" in the case where the related 
data of the e-mail format agrees ^vith character code 
data. It should be noted that the dataionmat information 
denotes Image/tifr in the case whore Ihe related data 
of the e-mail format agrees with mage tlata/Whenihe 
received data of the ^e-maii format agrees with character 
code data, the program advances from the step S21 to 
a step S22B. When the received data of the e-mail for- 
mat agrees with image d^. ihe received data of the e- 
mail format will be processed as in the embodiment of 
Figs. 3 and 4. 

The step S22B activates the font memory 1 2 so that 
the character code data is converted into corresponding 
image data according to the font data in the font mem- 
ory 12. 

A step S23 following the step S22B transfers the 
image data to the printer 11. Also, the step S23 acti- 
vates the printer 1 1 so that the image data is visualized 
or printed out by the device 11. After the step S23, the 
cunent execution cyde of the program segment ends. 

Fourth Embodimftn^ 

Rg. 7 shows a fourth embodiment of Ihis invention 
which is similar to the embodiment of Figs. 5 and 6 
except for an adcfitional arrangement descrfoed herein- 
after. 

With reference to Fig. 7. an electronic mail system 
includes a CPU 1 . a ROM 2. a RAM 3. a storage unit 4. 
a format converter 5. a scarvier 6, an operation panel 7. 
a data compressor/expander 8A a LAN (local area net- 
work) comroller 9. an inverse format converter 10, a 
printer 1 1 . a font memory 1 2. and a character recogni- 
tion unit 13 which are electrically connected via a bus 
line. The character recognition unit 13 serves to recog- 
nize characters represented l>y binary image data (bi- 
level image data). 

Informatiwi on a document sheet which is to t>e . 
transmitted contains information of the destination or 
the address of a tr an smitted e-nroS. Spectficatly, charac- 
ters in a pred^ermined zone of the docummt sheet 
indicate an e-mail destination. Thus, the chaiacters in 
the predetenmined zone of Ihe document sheet cc»Te- 
spond to the information of the e-mail destination. 

'The CPU 1 operates in accordance with aprogram 
stored in the ROM 2. Rg. 8 is a flowchart of a segment 
of the program. With r^erence to Fig. 8. a f kst step S31 
in the program segment decides whether or not a start 
Ixjtton on the operation panel 7 has been depressed. In 
the case where the start button on the operation panel 7 
has been depressed, the program advances from the 
step S31 to a step 332. Otherwise, the program repeats 
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the step S31. Thus, the steJWSl waits the depression 
of the start button. 

The step S32 activates the scanner 6 so that an 
image of the surface of a docunnent sheet in the scanner 
6 is converted by the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 

A step S33 lollowiring the step S32 extracts a portion 
of the binary image data which corresponds to the pre- 
deterrnned zone. The step S33 transfers the extracted 
portion of the image data to the character reoogniton 
unit 13. Further. the«tep .S33 activates the character 
recogrtittori unflt 13 so^lhat characters represwTted by 
the extracted portion of <he image data are recognized 
by thedevioe 3^.3?»e character recognition unit 13 g«»- 
erate6 A»torinalfan.«^ accordance vnth 

the resuft ofiHe character recognition. 

A step S34 «ubsequent to the step S33 transfers 
the binary imaoe<teta from the scanner 6 to the data 
conpressor/expander 8A. Then, the step S34 activates 
the data conpressor/expander 8A so that the binary 
image data is conripressed by the device 8A into com- 
pression-resultant image data of a given facsimile for- 
mat. Further, the step S34 transfers the compression- 
resultant image data of the facsimile format from the 
data compressor/expander 8A to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 

A step S3S following the step S34 transfers the 
conpression-resultant image data of the facsin«te for- 
mal frorn the storage unit 4 to the fonnat converter 5. In 
addition, the step S3S transfers the information of the 
destination to the format converter 5. The step S35 acti- 
vates the format converter 5 so that the compression- 
resultant image data of the facsimile format is converted 
by the device 5 into con^esponding image data of the e- 
mail format. The image data of the e^nail format con- 
tains the information of the destination. Further, the step 
S35 transfers the in«ge data of the e-mail format from 
the formal converter 5 to the storage unit 4 before stor- 
ing the image data of the e-mail format into the storage 
unit 4. 

A step S36 subsequent to the step S35 transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9. The step S36 acbvates the 
LAN controller 9 so that the image data of the e-mail tor- 
mat is further transferred from the LAN controller 9 to an 
e-mail computer 9A. The image data of Ihe e-mail -for- 
mat, ihat is. van^e-nMl. is transmitted from the e^nail 
conputer-9A7to -ihe destination via an «-niall ne*work 
9B. After the step S36. the current execution cyde of the 
program segment ends. 
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Fig. 9 shows a fifth embodiment of this invention 
which is similar to the embodiment of Figs. 1 and 2 
except for an additional arrangement deswibed herein- 
after. 

With reference to Fig. 9, an electronic mail system 
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includes a Cl4^. a ROM 2. a RAM 3. a storage unit 4. 
a format converter 5. a scanner 6. an operation panel 
7A a data conpressor 8. and a LAN (local area net- 
work) controller 9 which are electrically connected via a 
bus line. The operation panel 7A replaces the operatton 
panel 7 in Fig. 1. The operation panel 7A has a key 
board a start button, a source button, and other but- 
tons. Infomwtion of the destination or the address of an 
e-mail to be transmitted can be inputted into the elec- 
tronic mail system by operating the key board on the 
operation panel 7A. The scanner 6 can be activated Iv 
opiating the start button on the operation panel 7A. 
Infonnation of the address of an eniwil transmission 
source can be inputted into the electronic mail system 
by operating the source button on the operation panel 
7A. The source address agrees with an address 
assigned to an e-mail computer 9A connected to the 
LAN controller 9. Accordingly, in the event ttiat the trans- 
rrtssion of an e-maO from ttie electronic mail system to 
the destination has failed, a responsive ennajl repre- 
senting the transnassion failure can be received by the 
e-mail connputer 9A. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 1 0 is a flowchart of a segment 
of the program. With reference to Fig. 10. a first step 
S41 in the program segment decides ¥»he1her or not 
infonnation of the destination or Ihe address of an e- 
mail to be transmitted has been Inputted via tt»e opera- 
tion panel 7A. In ttie case where th e infor mation of the 
destination of an e-mail to be transn^tted has been 
inputted the program advances from the step S41 to a 
step S42. Othenwise. ttie program repeats the step S41 
Thus, the step S41 waits the reception of ttie informa- 
tion of an e-mail destination. 

The step S42 decides wh^er or not the source 
button on the operation panel 7A has been depressed 
to input the information of the address of the e-mail 
transmission source. In ttie case where ttie source but- 
ton on the operation panel 7A has been depressed, the 
program advances from ttie step S42 to a step S43. 
Ottienwse. ttie program repeatsttie step S42. Thus, ttie 
step S42 waits ttie reception of ttie information of an e- 
maii source address. 

The step S43 decides vohelher or not ttie start but- 
ton on ttie operatton panel 7A has been depressed. In 
ttie case where ttie start button on ttie operation panel 
7A has been depressed, ihe program advances from 
ttie step S43 to .a«tep544. Otheiwise. ttie program 
repeals ttie step S43. Thus, ihe step S43 waits ihe 
depression of ttie stEVt button. 

The step S44 activates the scanner 6 so ttwl an 
image of ttie surface of a docunent sheet in ttie scanner 
6 is converted t>y ttie scanner 6 into corresponding 
binary image data (corresponcfing bi-level image data). 
A step S45 following ttie step S44 ttansfers ttie binary 
image data from the scanner 6 to ttie data compressor 
8 Then, ttie step S45 activates ttie data compressor 8 
so that tiie binary image data is conpressed by the 
device 8 into conrpression-resuttant image data of a 
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given facsimile format. Further, the step S45 trar^sfers 
the compression-resultant image data of the facsimile 
format from the data compressor 8 to the storage unit 4 
before storing the compression-resuftant image data of 
the facsimile format into the storage unit 4. 5 

A step S46 following the step S45 transfers the 
compression-fesuftant image data of the facsimile for- 
nnat from the storage unit 4 to the forniat converter 5. in 
additk»i, the step S46 transfers the information of the 
source address and the tnformatkm of the destinations 10 
the forrat^^^ S46 activatesihe for- 

'T^^B^^J^^?^^ compression-resuttant 
; innage^c^^^ iacGrnae^^f^^ by the 

defi>i08f>5^i^^ e-mail 
fornriatW!vd|ra 75 
infoiinatiofi of the source adcfress and the information of 
the destinatibn:? Further, the step S46 transfers the 
image data of the e-mail format from the format con- 
verter 5 to the storage urvt 4 t>efore storing the image 
data of the e-mail format into the storage unit 4. 20 

A step S47 sut)sequent to the step S46 transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controller 9 The step S47 activates the 
LAN controller 9 so that the image data of the e-mail for- 
mat is further transfen-ed from the LAN controller 9 to 2s 
the e-mail computer 9A The intage data of the e-mail 
format that is, an e-mail, is trar^rotted from the e-mail 
conrputer 9A-to the destination via an e-mail network 
9B. After thestep S47. the current e^^cution cyde of the 
program segment ends. 3^ 

Sixth Embodinwfit 

Rg. 1 1 shows a sixth embodiment of this invention 
which is similar to the embodiment of Figs, 7 and 8 3S 
except for an additional anangement described herein- 
after. 

With reference to Fig. 11 . an electronic mail system 
includes a CPU 1. a ROM 2. a RAM 3. a storage unit 4. 
a format converter 5. a scanner 6, an operation panel 40 
7B. a data compressor/expander BA a LAN (local area 
network) controller 9. an inverse format converter 10. a 
printer 11. a font memory 12. a character recognition 
unit 13, an audio input/output device 14. and an audio 
compressor/expander 15 which are electrically con- 45 
nected viaaixis line The operation panel 7B replaces 
the operatim panel 7^n Fig. 7. The operation panel 7B 
has a start button, a message button,and other buttons. 
The scanner 6 can be>activated by opiating the start 
button on the operation panel 7B. Tlie depression of the so 
message txitton on the operation panel 7B enables 
audio message infonmation to be inputted into the elec- 
tronic mail system The audio input^output device 14 
includes a microphone and an electric-to-sound trans- 
ducer such as a loudspeaker (a sound speater). The 55 
microphone in the audio input/output device 1 4 converts 
a sound message into a conresponding audio signal. 
The audio signal is changed into conresponding audio 
data by an A/D converter in the audio input/output 



device 14. The audio input/output device 14 also 
includes a D/A converter which changes audio data into 
a conesponding audio signal. The audio signal is con- 
verted into conesponding sound by the loudspeaker 
(the sound speaker) in the audio input/output device 14. 
The aucfio compressor/expander 1 5 serves to conpress 
and expand aucfio data. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Rg. 12 is a flowchart of a first seg- 
ment of the program. A/Vith reference to Rg. 12, a first 
step S51 in the first program segnrtent decides whether 
or not the start button on the operation panel 7B has 
been depressed. In ihe case ^Arhere the start button on 
the operation panel 7B ttas been <Jepressed.*e pro- 
gram advances from the step S51 toa step S52. Other- 
wise, the program repeats the step S51 . Thus, the step 

55 1 waits the depression of the start button. 

The step S52 decides whether or not the message 
button on the operation panel 7B is d^ressed and a 
sound message is converted by the microphone and the 
A/D converter in the audio input/output device 14 into 
corresponding audio data. This decision is to wait the 
depression of the message button and the reception of 
the audio data. In the case where the message button 
on the operation panel 7B is depressed and the sound 
message is converted by the audfo input/output device 
14 into the corresponding aucfio data, the step S52 
transfers the audk) data from the audio irput/output 
device 14 to the audio conpressor/expander 15. The 
step SS2 activates the audio compressor/expander 15 
so that the audio data is compressed by the device 15 
into compressfon-resuttant audfo data. Further, ihe step 

552 transfers the compression-resuitant audio data 
from the audio compressor/expander 15 to the storage 
unit 4 t)efbre storing the compression-fesuftant audio 
data into the storage unit 4. 

A step S53 sut>sequent to the step S52 activates 
the scanner 6 so that an image of the sirface of a doc- 
ument sheet in the scanner 6 is converted by the scan- 
ner 6 into correspmding tjinary intage data 
(corresponding bi-level image data). 

A step S54 following the step S53 extracts a portion 
of the binary image data which con-esponds to a prede- 
termined zone. The step S54 transfers the extracted 
portfon of the image data io Ihe character recognltfon 
urtit 13. Further, the step S54 activates the character 
recognition unit 13 so that characters represented by 
the extracted portion d the knage data are recognized 
bythedevfce 13, The character recognition unit 13 gen- 
^Htes information of a destination in accordance with 
the result of the character recogrvtion. 

A step S55 subsequent to the step S54 transfers 
the tiinary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S55 activates 
the data compressor/expander 8A so that the binary 
image data is conrpressed by ttie device 8A into com- 
pression-resultant image data of a given facsimile for- 
mat. Further, the step S55 transfers the conpression- 
resultant Image data of the facsimile format from the 
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data compressor/expandSWA to ttne storage unit 4 
before storing the campression-resunam .mage data o1 
the lacsimile torniat into the storage unit 4. 

A step S56 follownng the step S55 transfers the 
corrpression-resultant image data of the facsimile for- 
rr^Lr^ the storage unit 4 to the to"™^*'^^;?^" 
addition, the step S56 trar^fers the ^^^^''^'^^^ 
destination to the lormat corrvrerter 5. F^i^ier tt,e s^ 
Ise transmits the eonpresston-resuttant aud.o d«a 
from the storage unit 4 to the 
step S56 activates the format converter 5 so that tt^e 
wmpression^esultant image data of the facsimile tor- 
matand the compressiorwesuttant audio data are oor^ 
verted and integrated by the Ajnto 
corre^nding image/audio data of «je J 
should be noted that the manner of the integration isin 
SSonnity with the M\MB standards. The|rmge/audo 
data of the ennail format contains the infontaftwi of tt^e 

SSination. Further, the step ^J^U^, 
Image/aucfio data of the e-mail formatttom ittie fomat 
SSerter 5 to the storage unit 4 betare «onngthe 
image/audio data of the e-nr«il format mto the storage 

A step S57 subsequent to the step S56 transfers 
the image/audio data of the e-mail 
age unrt 4 to the LAN corrtrolter 9. The step ^7 act^ 
vStesthe LAN controller 9 sothat^e ^^^^ ^ 
of the e-mail fomat is further transferred from the 
controUer 9 to an e-mail computer 9A. T>«e imagerm^o 
data of the e^nail format that is. an e-mail. is tmnsmrt- 
ted from the e-mail computer 9A to the ^^r«^vja 
an e^nail iiet»«»k 9B. After the step SSVlheoirrent 
execution cycle of the first program segment erids^ 
Fia 13 is a flowchart of a second segment erf the 

progrSi. With reference to Fig. 13. a first siep S58A m 
th^second program segment decides ^.^etfier or no^ 
data of the e-mail format has been receivedby the ^N 
controller 9. This decision is to wait the °! 
of the e-mail format. In the case where of ^ 
mail format has been received, the step SSaA transfers 
the received data of the e-mail formattotheslora^unrt 

4. The step S58A controls the storage unrt *«> ttet tt^e 
received data of the e-mail format is stored mto the stor- 

Tsttp S58B following the step S58A transfers the 

received data of the e-mail ^""^"^^^ 
4 to the inverse format converter 10. A step S58C suck 
sequent to the step S58B decides wrtielher or not the 
^ecSved data of the .e-mail iormal agrees vnth 
image/audo data of ihe annaa format by r^e^ to 
re«ed Information in the header of therecer^dateo^ 
the e-mail fontiaL When the received data agrees witn 
image/audo data, the step S58C *=*2^al'Z^ 
format converter 10 so that the received data-of the e- 
mail fonnat is converted and separated by the dwK»1 0 
into image data of a given facsimile fomiat and autto 
data When the received data differs from image^audio 
data, the received data v«ll be processed as in the 
embodiment of Figs. 3 and 4. 
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A Step A> following the step S58C transfers the 
i„«ge dataXe facsimile format from ^^^^^^^ 
mat converter 10 to the data compressor/expander 8A^ 
The steo S58D activates the data compressor/expander 
8A so^t the image data of the facsimne formart « 
exoanded by the device 8A into expansion-resultant 

STimage data (e^""-'**""^^'-'^^'"^^ 
dS^ Further, the step S58D transfers tt'e e^^" 
resJtant binary image data from data cornp^«- 
^^^er BAto the storage unit4 t>efore stonng the 
^.St^esunant binary image data into the storage 

A step S58E subsequent to the step SS80fransf»s 

«,e expansion-resultant binary Image 
storageunrt4tothe printer 1V The step SS8E activ^^ 
the jxinter 11 so that the expansion-reailtant binanr 
image data is visualized or printed out by the de^ce l v 
\ step S58F foll««ng the step S58E tar«te^ me 
audio data from the inverse tomw* «^«;^22p^!l* 
aSio coTTpressor/expander 15. The st^ S58F acb^ 
^es the audio conpressor/expander 15 so that me 
audio data is expanded by the d««ce 1 5 into expansjon- 
f^n^ aud!?^. Further, the step «8F tansters 
the expansion-resultant audio data from the audiocom- 
prtiS^expander i5 to the storage unrt 4 before stonng 
S^^^ultant audto data into the storage unrt 

AstepS58GafosequenttothestepS58Ftransfers 
the expansion-resultant audto datafromthe storage ijrt 
TtoTe audto mput/ouftxit devfoe 14. The step^G 
activates the audto inputtoutput <l»nce 14 so that the 
SS^ter (the sound^ker) andthe D/A conv^r 
thlSTgenerate sound in response to l^e audio dattt 
After the step S58G. the current execution cyde of the 
second program segment ends. 
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ft^«»nth Ej ^Thndir^errt 

Fig 14 Shows a seventh embodiment Of this inven- 
tion whtoh is Similar to the enttodiment ofFigs.n -13 
except for an additional arrangement described herein- 

Wrth reference to Fig. 14. an electronic mail system 
includes a CPU 1 . a ROM 2. a RAM 3. a storage unrt 4 
a Smat converter 5. a scanner 6. an operation panel 
TcHdLta compressor/expander 8A. a LAN (local area 
network) controUer 9. an inverse format ""'^^f^JO- ^ 
printer 11 . a fort memory 12. a character re^g^tion 
unit 13. an audto input^oulputtJence 14. an audto com- 
pressor/expander 15. a video irput/outpot dence 16. 
^iSsH-cture compressor/expander 17^ 
are electrically connecled viaa bus Itoe. The o^ration 
panel 7C replaces the operation.panel 7B « p9 

operation panel 7C has a start button, a vic^^ 
ton. and omer buttons. The scanner 6 can be acb^ed 
by operating the start button on the operation panel 7C. 
Thedepression of the video button on the operation 
oanel 7C enables moving-picture infomiabon to be 
irputted into the electronic mail system. The video 
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input/output device 16 includes a video camera and a 
display such as a CRT The video camera in the video 
input/output device 16 converts moving pictures into 
con^esponding data. The display in the video irput/out- 
put device 16 visualizes moving-picture data. The mov- 
ing-picture compressor/expander 1 7 serves to 
compress and expand moving-picture data. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 15 is a flowchart of a segmmt 
of 1he~prDgFam. With re^enoe to Fig. 15, a first step 
S61 In^e progpBm ceginem 

pP«»tion pane! 7C has t>een 
ri??!!?^S^%^l!!*!?l^^^ on the 

advancMirom.1he step S^^ Otherwise, 
the program repeatsihe step S61 . Thus, the step S61 
waits 1he depression of the start txitton. 

The step S62 decides whether or not the video but- 
ton on the operation panel 7C is depressed and moving 
pictures are converted l>y the video camera in the video 
input/output device 16 into con-esponding data. This 
decision is to wait the depression of the video button 
and the reckon of moving-picture data. In the case 
where the video button on the operation panel 7C is 
depressed and the nx)ving pictures are converted by 
the video camera in the video input/output device 16 
into the con-esponding data, the step S62 transfers the 
moving-picture data from the video input/output device 
16 to the moving-picture compressor/expander 17. The 
step S62:-£activates the moving-picture compres- 
sor/expander 1 7 bo that the moving-picture data is com- 
pressed by :lhe device 17 into compression-resuttant 
moving-picture data. Further, the step S62 transfers the 
compressronrresultant nKJving-picture data from the 
moving-picture compressor/expander 17 to the storage 
unit 4 before storing the compression-resultant moving- 
picture data into the storage unit 4. 

A stepr S63 siijsequent to the step S62 activates 
the scanner € so that aaimage of the surface of a doc- 
ument sheet in the scanner 6 is converted by the scan- 
ner 6 into conesponding binary image data 
(corresponding bi-level image data). 

A step S64 following the step S63 extracts a portion 
of the binary image data which conesponds to a prede- 
tem^ned zone. The step S64 transfws the extracted 
portion of tf^ image data to the character recognition 
unit 13. Further, the step S64 activates the character 
recognition unit 1 3 «)ihat characters represented by 
the extracted portion ofihe image data are recognized 
by the device 13. The character recogrntim urtttl 3 gen- 
erates information of a destination in accordance with 
the result of the character recognition. 

A step S65 subsequent to the step S64 transfers 
the binary image data from the scanner 6 to the data 
compressor/expander 8A. Then, the step S65 activates 
the data compressor/expander 8A so that the binary 
image data is compressed by the device 8A into com- 
pression-resultant image data of a given facsimile for- 
mat. Further, the step S65 transfers the compression- 
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resultant image data of the facsimile format from the 
data compressor/expander 8A to the storage unit 4 
before storing the compression-resultant image data of 
the facsimile format into the storage unit 4. 

A step S66 following the step S65 transfers the 
compression-resultant image date of the facsimile for- 
mat from the storage unit 4 to the fonnat converter 5. In 
addition, the step S66 transfers the infomiation of the 
destination to the fomw converter 5. Further, the step 
S66 transnwts the compression-resultant moving-pic- 
ture date fnsm the storage unit 4 toihe format converter 
5. The step S66 activatesihe fonnat converter 5 so that 
the compressionH-esultant image date of the facsimile 
format and the compression-resultant moving-picture 
date are converted and inte^ed by the device 5 into 
corresponding image date of the e-mail fonnat It should 
be noted that the manner of the integration is in con- 
fonnity writh the MIME standards. The image date of the 
e-mail format contains the infonrotion of the destina- 
tion. Further, the step S66 transfers the Image date of 
the e-mail format from the format converter 5 to the stor- 
age unit 4 before storing the image date of the e-mail 
format into the storage unit 4. 

A step S67 subsequent to the step S66 transfers 
the image date of the e-mail fonnat from the storage unrt 
4 to the LAN contrdier 9. The step S67 activates the 
LAN controller 9 so that the image date of the e-mail for- 
mat is further transfened from the LAN controller 9 to an 
e-mail computer 9A. The image date of the e-mail for- 
mat, that is, an e-mail, is transnwtted from the e-mail 
confer 9A to the destination via an e-mail network 
9B. After the step S67. the current execution cycle of the 
program segment ends. 
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Fig. 16 shows an eigfrth embodiment of this inven- 
tion which is similar to the embodiment of Figs. 7 and 8 
except for design changes described hereinafter. 

With reference to Fig. 16. an electronic mail system 
includes a CPU 1 . a ROM 2. a RAM 3. a storage unit 4. 
a format converter 5. a scanner 6. an operation panel 7. 
a data compressor/expander 8A, a LAN (local area net- 
work) controller 9X. an inverse format converter 10. a 
primer 11. a font memory 12, and a character reco^i- 
tion unit 13 which are electrically connected via a bus 
line The LAN oontroUer 9X replaces the LAN controller 
9 in Fig. 7. The LAN controller 9X analyzes a received 
e-mail. The CPU 1 is programmed to execute tlata 

processing in response to a resiA of the analysis t>yihe 
LAN controller 9X. 

Fig. 17 ^hMs a part of an example of an e-mail in 
a givOT-formaL As shown in Fig. 17, the^^l has a 
header 31 and a text (a message) 32. The header 31 is 
followed by the text 32. The header 3 1 contains infonro- 
tion representing a type of data in the text 32. In the 
example of Fig. 17. "Content-Type : text/plain- in the 
header 31 represents that a related portion of the text 
32 corresponds to character code data. Further. "Sub- 
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iect in me header 31 reprSWte that a related por- 
tion of the text 32 corresponds to an instruction (a 
command). 

The text 32 contains ID (identification) infomiation 
Of a sender, information Of a list of destin^onn«n 

addresses, and information of a source address. The ID 
jntom«tk)n of the sender is 
code v«Kd "IID-. The information of the 
nSon mail addresses is preceded bv a specrfjed code 
word -lUSr . The infomiation of the source address is 
preceded Iv^ specified code word "IFROM". 

^ItiriSe LAN controller 9Teceives an.«^nail. «ie 
LAN:«iiitroBer9analyres iD<identification) infonnalion 

SriJSwTand information of a source address t«h«h 
jJ^^Ud in the received e-mail . Th e LAN conwMler 
9 recognizes the sender as a result of the analysis of ttie 
ID ilSrmtion thereof, "me CPU 
ID inlormation of the sender, the infonnabon of the list 
the destination mail addresses, and the information of 
the source address from the LAN controller 9 to the bor- 
age unit 4. Then, the CPU l serves to store the ID intor- 
mation of the sender, the information of the list 
destination mail addresses, and the information of the 
source address into the storage unH 4. 

hiinff^ piwhodiment 

Fig 18 shows a ninth «nt)Odiment of this invention 

which is similar to the embodiment of Figs. 7 and 8 
except for design changes described hereinafter. 

With reference to Rg. 18. an electronic n«il system 
includes a CPU 1 . a ROM 2. a RAM 3. a storage unrt 4 
a format converter 5. a scanner 6. an operation panel 
7D a data conpressor/expander 8A a LAN (local area 
network) controller 9. an inverse format converter 10. a 
printer 1 1 . a tort memory 12. and a character recogni- 
tion unit 13 which are electricaUy connected via a bus 
line. The operation panel 7D replaces the operation 
panel 7 in Fig. 7. The operation panel 7D has a display. 
Tkey board, a start button, a destination list button, and 
other buttons. Infonnation of a destination list <an be 
visualized by the display on the operation panel 7D ID 
information of a sender can be inputted into the elec- 
tronic man system by operating the key board on the 
operation panel 7D. The scanner 6 can be activated by 
operating the start button on the operation panel 7D. 
The depression of the destination list button on we 
operalian panel 70 enables atJestination list to be mdi- 
cated by (fisplay on the operation panel 7D. 

The CPU 1 operates in accordance with a proflp«m 
stored in the ROM 2. Fig. 19 is aflowchart ofafirstseg- 
ment of the program. With reference to Rg. 19vfJ^ 
stepS7l in the first program segment decides whetfw 
or not character code data in an e-mail has been 
received by the LAN controller 9. In the case where the 
character code data in the ennall has been received, 
the program advances from the step S71 to a step S72. 
Otherwise, the program repeats the step S71 Thus, the 



step S71 waits inception o< character code data in 
an e-mail. The st^S72 analyzes the "Subject" part of 
the header of the e-mail. 

A step S73 following the step S72 decides whether 
or not the 'Subject" part of the header corresponds to a 
text instruction by referring to the result of the analysis 
by the step S72. When the "Subject' part of the header 
corresponds to a text instruction, the program advances 
from the step S73 to a step S74. Othemnse the pro- 
gram advances from the step S73 to a step S76. 

The step S74 analyzes the text in the e^nail to 
extract ID information of a sender and information ofa 
destination mail list therefrom. A step 875 loUowuig J»e 
step S74 stores or registers the ID information of tf« 
s^er and the inlormation of the destination mailtet 
irtothe storage unrt 4 in a manner such ^DjT^^- 
mation of the sender and the information of the destina- 
tion mail list are in a given correspondence relation. 
Alter the step S75. the current execution cycle of the 
f irst program segment ends. 

The step S76 converts character code data in the 
text irto corresponding image data. A step S77 follow- 
ing the step S76 transfers the image data to the prirter 
11 The step S77 activates the prirter 11 so that the 
image data is visualized or prirted out by the d»«ce 11 . 
After the step S77. the currert execution cyde of the 

first program segment ends. ^^^^ 
Fig 20 is a flowchart of a second segmert of the 

program. With reference to Fig. 20. a first step S8i of 
tt,e second program segmert decides whettier or nrt 
the destination list button onihe operation pan^ JD Itas 
been depressed. In the case where the destination tet 
button on the operation panel 7D has been depressed, 
the program advances from the step S81 to a Step S^. 
Othen««se. ttw program repealsttie step 881 . Thus, toe 
step S82=warts the depression of ttie destination list but- 

The step 882 decides whettier or not ID information 
of a sender has been inputted via the operation panel 
7D This decision is to wait ttie reception of sendw ID 
infomiation. In ttie case where ttie ID information of tiie 
sender has been irputted. ttie step 882 reads out infor- 
mation of a destination «iaa list from ttie storage unrt 4 
which corresponds to ttie ID infomnation of ttie sender. 
The step 882 tiansfers ttie information of ttie destina- 
tion mail list to ttie display on ttie operation panel 70. 
The step 882 activates ttie display on ttie operation 
panel 70 so that ttie infomiation of the destination mail 

list is visualized ttiereby. o..^, 

A step 883 following ttie step 882 deades whettier 

or not a destination has been selected from ttie visual- 
ized destination mail list by actiiating ttie operation 
panel 7D. In Ihe case where a destination hasbeen 
selected, ttie program advances from ttie step 883 to a 
step S84. Ottiennnse. ttie program repeats ttie step 583. 
Thus ttie step 883 warts ttie selection of a destination. 

The step 884 decides whettier or not ttie start but- 
ton on ttie operation panel 70 has been depressed. In 
the case where ttie start button on ttie operation panel 



30 



35 



40 



45 



SO 



SS 



11 



3NSOOC1D:<EP 0801492A1> 



21 



EP 0 801 492 A1 



i22 



7D has been depressed, the program advances from 
the step S84 to a step S85. Otherwise, the program 
repeats the step S84. Thus, the step S84 warts the 
depression of the start button. 

The step S85 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted l>y the scanner 6 into corresponding 
binary image data (corresponding bi-level image data). 

A step S86 subsequent to the step S85 transfers 
the binary image datairom the scanner 6 to the data 
conpres^>c^epqpa]Xler^^^ step S86 activates 

i c***.5tote-coi¥p^ ZfK so that the binary 

: 8A into com- 

presstofMBsUtt^ of a given facsinvie for- 

mat*^Further;tmter8tep see transfers the corrpression- 
resuttant image data of the iacsintile format from the 
data -compressor/expander 8A to the storage unit 4 
before storing the compression-resuttant image data of 
the facsimite format into the storage unit 4. 

A step S87 following the step S86 transfers the 
compression-resultant image data of the facsimile for- 
mat from the storage unrt 4 to the fonnat converter 5, In 
addition, the step S87 informs the fomiat converter 5 of 
the selected destination. The step S87 activates the for- 
mat convwter 5 so that the compression-resultant 
image data of the facsimile format is converted by the 
device 5 into con-esponding image dafa of the e-mail 
format. ^The image data of the e-mail fonnat contains the 
information *of the destination. Further, the step S87 
transfers the image data of the «-mail fonnat from the 
format ^converter 5 to the storage unit 4 before storing 
the image data of the e-mail format into the storage unit 

A^ep^SSa subsequent to the step S87 transfers 
the image data of the e-mail format from the storage unit 
4 toihe LAtg controller 9. The ^ep S88 activates the 
LAN controller 9 so that the image data of the e-mail for- 
mat is further transferred from the LAN confroller 9 to an 
e-mail computer 9A The image data of the e-mail for- 
mat. that is. an e-mail, is transmitted from the e-mail 
computer 9A to the selected destination via an e-mail 
network SB. After the step S88. the cunent execution 
cyde of ttie second program segment ends. 

T<enth gmbodirnffla 

Fig. 21 shows^ tOTth embodiment of tWs invention 

whichissrmflartothe-embodinfiertofFtj^ 18-20 except 
for design changes described her«nafter. 

With reference to Ftg. 21 , an electronic mafl system 
includes a CPU 1 . a R0IWI 2. a RAM 3. a storage unit 4. 
a format converter 5, a scanner 6. an operation panel 
7E. a data conpressor/expander 8A a LAN flocal area 
network) controller 9. an inverse fonnat converter 10, a 
primer 1 1 . a font memory 12. and a chaiacter recogni- 
tion unit 13 which are electricaUy connected via a bus 
line. The operation panel 7E replaces the operation 
panel 7D in Fig. 18. The operation panel 7E has a dis- 
play, a key board, a start button, a source button, and 



other buttons. Information of a source address can be 
visualized by the display on the operation panel 7E. 
Information of the destination or the address of an e- 
mail to be fransmitted can k>e inputted into the electronic 
5 mail system by operating the key board on the operation 
panel 7E. ID information of a sender can be inputted 
into the elecfronic mail sy^em by operating the source 
button on the operation panel 7E. The scanner 6 can be 
activated by operating the start button on the operation 
10 panel 7E. 

The CPU 1 operates in accordance with a program 
stored in the FSOM 2. Ftg. 22 w a f towchart of a first sag- 
ment of the program. With reference to Fig. 22. a first 
step S71A in ihe first program segment decides 
T5 whettier or not character code data in an e-mail has 
been received by the LAN controller 9. In the case 
where the character code data in the e-mail has been 
received, the program advances from the step S71 A to 
a step S72A. Othenvise. the program repeats the step 
20 S71 A Trnjs. the step S71 A waits the reception of char- 
acter code data in an e-maiL The step S72A analyzes 
the "Sitfject- part of the header of the e-mail. 

A step S73A fr>llowing the step S72A decides 
whether or not the "Subject- part of the header cone- 
ys spends to a text insfruction by refening to the result of 
the analysis by the step S72A. When the -Subject** part 
of the header corresponds to a text insfruction. ttie pro- 
gram advances from the step S73A to a step S74A. 
Othenvise. the program advances from the step S73A 
30 to a step S76A 

The step S74A analyzes the text in the^-mail to 
extract ID infomiation of a sender and information of a 
source address therefrom. A step S75A fdfowhng the 
step S74 A stores or registers the ID infonnation of the 
35 sender and the information of the source address into 
the storage unit 4 in a manner such that the ID infonna- 
tion of ttie sender and the information of the source 
address are in a given conespondence relation. After 
the step S75A, the cunent execution cyde of the first 
40 program segment ends. 

The step S76A converts character code data in ttie 
text into conesponding image data. A step S77A follow- 
ing the step S76A fransfersthe image datato ttie printer 
11. The step S77A activates ttie printer 11 so that ttie 
45 inr«ge data is visualized or printed out by ttie device 1 1 
After ttie step S77A the cunent execution cyde of ttie 
first program segment ends. 

Rg. 23 a flowchart of « second segnwrt of the 
program. With reference to Fig. 23. a fire* step S82A of 
so 1he second program segmentdeddes Whether or not ID 
infomiation of a sender has been inputted t>y depress- 
ing -the source button on the operation panel 7E. This 
decision is to wait the reception of smder ID infomia- 
tion. In the case where the ID information of the sender 
55 has been inputted, the step S82A reads out infomiation 
of a source address from the storage unit 4 which cone- 
sponds to the ID information of the sender. The step 
S82A transfers the information of the source address to 
the display on the operation panel 7E. The step S82A 



12 



:<EP 0801492A1> 



23 

he ij^ai 



EP 0 801 492 A1 



24 



10 



15 



20 



25 



30 



address. o82A deddes 

A Step S83A toUo^ng f ^J^^n or the 
whether or not ''^'^r^^/^'^^i^s beer, input- 

•ntormation of the «*«^TTe p««am advances from 
„«ed has '^t^'^^I'SS^se. the program 
«t«P^^,|S? ^ mTstep S83A waits the 
repeats the sWP.^l^'!^ destinalion. 

sn»es4epS»4Aaw»' depressed, m 

oolheopembonj^ei^has p^^^, 

case Where the^t^n oj;^^,^ 
7E has been deprew«>^ t-^ 

'^'^a^^rJ^t^.ST^ S84A waits the 
repeats the step S8*^ ' 

'^^r^^^ S^^cSS the scanner 6 so that ^ 
The step 5>w^ scanner 
^^geotthesurtaceo^a^-em^^^^ 

6 IS converted S'.^^^Tng bi-level image data), 
binary image data (cofresporwi g S85A transfers 
AstepS86As^^emtoJh^^^S85, the data 
the binary image data ^"^^1^^^ S86A acli- 
conpressor/expander 8^^e J so that the 

"^^r^^^ the device 8A into 
binary image data .s ^^^^^ ^ gi^en iacsimile 

.tormat Further, the ^^^^J, J^^te format from 
sion-resuttant image J^J^q the storage unit 4 

Ko^rirp Storing the compression 

A step S87A facsimile for- 

compression-resultant "^9'^°^^,^^ converter 5. in 
n,at from the storage unrt4tottietorn«^ ^^^^ 

addition, the.siep S87A .^"^"^ '^^ destination to 
source addressand^e^rm^^o^*^^ 

the format conv^er «■ ^ ^ession-resuttant 

converter 5 «> *^„STconverted by the 

image data of of the e-mail 

device 5 into ^^Z^y^cor^ns^ 

format The image ^^^^^^^e information of 
infomtationofthes«*ceaddr^t|Tn^^ ^ 

the destination. Further. the^ SBTA^ ^ 

"^^IST^TZmQ it^e image 
verterStothesttwgeu^ 

LAN controller 9 ^J^^^^l ^ ^nfroller 9 to an 
^ is further transfen^ ^Z^^ S7e e-mail for- 



the second pro0« segment 



ends. 
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p.g. 24 Shows a twetffh 

tion wSich is Similar ^/^^^t^f^er. 
15 except for des«sn ^^^^^ tJ^cwnic mail system 
With reference ^ ^jS^!^. ane^ 4. 
indudesaCPU l^aRO»^ operation panel 

a format converter 5. a 8«nr, 
7F. a data «>^'«^'':?^e to^^t inverter tO. a 
network) controller 9. ^^^^^^cter recognition 
printer 11. a font "^Jf'^^^^ an audio com- 

pressor/e^erl^^ ^^^^ ^ ^em 

^x^«ng-plcture «»nP'e»ww ^ The 

18 Which are ««,«frSl^^^tion pane. 7C in 
°P^*^ P^L^J^?^7F^,^atey board, a start 
Fig. 14. The operation P*"«'/\,"r and other buttons. 

.formation of *«f^^^^ed into the electron,c 
*° *'*'*?!^^th^ on the operation 

n«« system by operatincrttw^^ ^^^on tele- 

iTcTti^C^^nto J.e electronic m.1 
phone number can °« "T: the operaton 

system by operating ^^^^^^^^ by operating 
pane. 7F. ^^t^^^,^^ IF. dperation of 
the start button on «^jL^^^°;j5«nged between an 
the electronic ma.1 system can » operating the 

e^nail mode and a facsimrte m^Y ^ 

selection button on the ope^^ 
:;:;-i-J:r;rt1s^af^.eafac.mi.e 

^igr^toandfromi^^aj^-^^aprogram 
The CPU 1 op«a*« of a segment 
stored in the ^^J;^fJ^J^S^5. a first step 
of the program. ^*l^S^es whether or notthe 
S91 intheprogramsegrnerttdeaow ^ 

^ ST ^r^STSe nSTselection 

»^ JCJ2L^d?F has been opernled. 

»*rtton on the OP^;??^!"^^^^ S91 toa step S92. 
the program advances S91 . TT^us. the 

O^'^^-^-^^'^J.^^Slt^eCion button. 

The step aewt^ ^^iftHed bv referring to a 
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selected, the program advances from the step S92 to a 
step S93. When the e-mail mode has been selected, the 
program advances from the step S92 to a step S96. 

The step S93 decides whether or not information of 
a destination telephone number has been inputted via 
the operation pane) 7F Also, the step S93 decides 
whether or not the start button on the operation panel 
7F has been depressed. In the case where the informa- 
tion of -the ttostiraftion telephone nurTt>er has been 
inputted and the startixjtton on the operation panel 7F 
has t>een {depressed., the myogram advances from the 
stBp to]a s^3SM.:OthenMse. the program repeats 
tli«ji£^ S93 waits the reception of 

itiiomaldm'^^ telephone number and the 

depression of the start txjtton. - 

Tbe-step SSA activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into con-esporxSing 
binary image data (corresponding bi-ievel image data). 
A step S95A followtng the step S94 transfers the binary 
image data from the scanner 6 to the data compres- 
sor/expander 8A. Then, the step S95A activates the 
data compressor/exparxjer 8A so that the binary image 
data is compressed by the device 8 into compression- 
resuttantimage data of a given facsimile format. 

A step S95B sutjsequent to the step S95A transfers 
the compression-resultant image data of the facsimile 
format from'the data compressor/expander 8A to the 
modem 18. The step S95B activates the modem 18 so 
that thefcompression-resuttant image data of the fac- 
simile ICHTnat (that is. the facsimile signal) is outputted 
from thetnodem 1 8 to the telephone Hne. Mormatly. the 
facsirr^le -signal is transmitted via the t^ephone line to 
the cormminication opposite party identified by the des- 
tination telephone number. After the step S95B. the cur- 
rent execution cycle of the program segment erxte. 

The^ep S96 decides whether or not information of 
the destination or the address of an e-mail to t>e trans- 
mitted has been inputted via the operation panel 7F. In 
addition, the step 896 decades whether or not the start 
button on the operation panel 7F has been depressed. 
In the case where information of tfie destination of an e- 
mail to be transnvtted has been inputted and the start 
button on the operation panel 7F has t>e6n depressed, 
the program advartces from the step S96 to a step S97. 
OthenMise. the program repeats the step S96. Thus, the 
step S96 waits the reception of information of an e-mail 
destination and the depresskHi of the start button. 

The step 897 ^activates the scann^ 6 so that an 
image of the surface of a document sheet in the scarmer 
6 is converted t>y the scanner € into corresponding 
binary image data (corresporKting bi-level image data). 
A step 898A following the step 897 transfers the binary 
image data from the scanner 6 to the data compres- 
sor/expander 8A. Then, the step S98A activates the 
data compressor/expander 8A so that the biriary image 
data is compressed by the device 8 into corrpression- 
resultant image data of a given facsimile format. Fur- 
ther, the step S98A transfers the compression-resultant 
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image data of the facsimile format from the data com- 
pressor/expander 8A to the storage unit 4 before storing 
the compression-resuttarrt image data of the facsimile 
format into the storage unit 4. In the case where the 

5 transmission of information on a plurality of document 
sheets (that is. a plurality of pages) is required, the doc- 
ument sheets are sequentially scanned by the device 6 
and the compression-resultant image data of the fac- 
sirrvle format is stored into the storage unit 4 as a single 

10 file having a plu-ality of pages. 

A step 898B following the step S98A transfers the 
compression-resultant image data of the facsimtle for- 
mat from the storage unit 4 to the format converter 5. 
The step S98B activates the format converter 5 so that 

15 the compresston-resuttant image data of the facsimtle 
format is converted by the device 5 into conresporxiing 
image data of the e-mail format In addition, the step 
S98B transfers the image data of the e-mail format from 
the format converter 5 to the storage unit 4 t>efore stor- 

20 ing the image data of the e-mail format into the storage 
unit 4. 

A step 899 subsequent to the step 898B transfers 
the image data of the e-mail format from the storage unit 
4 to the LAN controlter 9. The st^ 899 activates the 

25 LAN controller 9 so that the image data of the e-n^l for- 
mat is further transferred from the LAN controller 9 to an 
e-mail computer 9A. The image data of the e-mail for- 
mat, that is. an e-mail, is transmitted from the e-mail 
conputer 9A to the destination via an e-mail network 

30 9B. After the step 899, the current execution cycle of the 
program segment erxls. 

Thirteenth Embodiment 

35 A thirteenth emtxxfiment of this invention is similar 
to the embodiment of Figs. 24 and 25 except for design 
changes descrit>ed hereinafter. 

Ftg. 26 is a f lowc^iart of a segment of a program for 
controlling a CPU 1 (see Fig. 24) in the thirteenth 

40 embodiment. With ref^ence to Fig. 26. a first step 81 01 
in the program segment decides whether or not data of 
the e-mail format has been received by a LAN controller 
9 (see Fig. 24). This decision is to wait the reception of 
data of the e-mail formal In the case where data of the 

45 e-mail fornnat has t>een received, the step 8101 trans- 
fers the received data of the e-mail format to a storage 
unit 4 (see Fig. 24). The step 8101 controls the storage 
unit 4 so that the received data of the e-mail format is 
stored into the storage unit 4. 

so A step 8102 following the step 8101 decides 
whe^er or not the received data of ttte e-mail format 
agrees with image data of the e-mail fomtat t>y referring 
to related information in the header of the received data 
of the e-mail tormat When the rec^ved data agrees 

55 with image data, the program advances from the st^ 
8102 to a step 8103. When the received data differs 
from image data the program advances from the step 
SI 02 to a step 8104. The step 8103 transfers the 
received data of the e-mail format from the storage unit 
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4 to an inverse format convellPiO (see Fig. 24). The 
step Si 03 activates the inverse format converter 10 so 
that the received data of the e-mail format is converted 
by the device 10 into corresponding image data of a 
given facsimile format The step 104 controls a LAN 
controller 9 (see Fig. 24) so that a responsive e-maii 
representing an error will t>e transmitted to the source 
concerning the received data of the e-mail format. After 
the step S104. the cun^ertt execution cyde of the pro- 
gram segment ends. 

A step S105 following the step S103 transfers the 
image data of *e facsimile iomaX from the inverse for- 
mat convwter 10 to a data compressor/expander 8A 
(see Fig. 24). The step Si 05 activates the data conrv 
pressor/expander 8A so that the innage data of the fac- 
simile format is expanded by the device 8A into 
expansion-resultant binary innage data (expansion- 
resultant bi-4evel image data). Further, the step Si 05 
transfers the expansion-resultant binary image data 
from the data compressor/expander 8A to the storage 
unH 4 before storing the expansion-resultant binary 
image data into the storage unit 4. 

A step SI 06 subsequent to the step Si 05 transfers 
the expansion-resultant binary image data from the 
storage unit 4 to a printer 11 (see Fig. 24). The step 
SI 06 activates the printer 11 so that the expansion- 
resultant binary image data is visualized or printed out 
by the device 11. 

A step SI 07 following the step S106 decides 
whether or not a reception waiting flag has been set 
When -the reception waiting fiag has been set. the pro- 
gram advances from the step S107 to a step SIOB. Oth- 
erwise, the program exits from the step S107. and the 
current execution cyde of the program segment ends. 

The step 108 controls the LAN controller 9 so that 
an e-mail representing a reception notice will be trans- 
mitted to a previously-registered terminal (a previously- 
registered terminal station). After the step Si 08. the 
cun-ent execution cyde of the program segment ends. 

Setting the rebeption waiting flag is implemented by 
previously transmitting an e-mail in whi* a text has 
"IRCV SET" according to the format of Fig. 17. Reset- 
ting the reception waiting flag is implemented by trans- 
mitting an e-mail in which a text has "IRCV RESET" 
according to the format of Fig. 1 7. - 

F fflirteenth f mbodiment 

A fourteenth errtxxfiment of this invention is similar 
tothe entXJdiment of Ftgs. 24 and 25^xcept for design 
changes descrft>6dherOTtafter., - 

Fig. 27 is aflowchart of a segment of aprogram for 
controlling a CPU 1 (see Rg. 54) in the foirte^th 
embodiment. With reference to Fig. 27, a first step S1 1 0 
in the program segment deddes whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wart the reception of image data of the e-mail format. In 
the case where image data of the e-mai! format has 
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been received.© step Si 10 transfers the received 
image data of the e-mail format to a storage unit 4 (see 
Fig. 24). The step S1 10 controls the storage unit 4 so 
that the received image data of the e-n^l format is 
stored into the storage unit 4. 

A step S11 1 following the step Si 10 transfers the 
received image data of the e-mail format from the stor- 
age unrt 4 to an inverse formal converter 10 (see Fig. 
24). The step Sill activates the inverse format con- 
verter 10 so that the received image data of the e-mail 
fomial is converted by the device 1 0 into corresponding 
image data of a given tacsimne formal Then, the step 
S1 11 transfers the image data of the facsimile format 
from the inverse format converter 10 to the storage mit 
4 before storing the image data of the facsin^le format 
into the storage unit 4. 

A step S1 12 subsequent toihe step S1 1 1 analyzes 
the •Subject" part of the header of the received e-mail. 
In the case where the analyzed •Subject" part of the 
header includes a requirement for facsimile transmis- 
sion, the step S1 12 extracts information of a destination 
telephone number from a portion of the received e-mail 
which immediately follows the "Subject part. 

A step S1 13 following the step S1 12 deddes 
whether or not a requirement for facsimile transmission 
is present When a requirement for facsimile transmis- 
sion is present, the program advances from the st^ 
S1 13 to a ^ep S1 14. Othenwise. the program advances 
from the step S11 3 to a step S1 1 5 A 

The step S1 14 transfers the image data of the fac- 
simile format ircwnihe storage unitai toa-nxxJem 18 
(see Fig. 24). The step S1 14 activates the modem 1 8 so 
that the image data of the facsimile fomnat (that is. the 
facsimile signal) is outpulted from the modem 18 to a 
telephone line. ftormaUy. the facsimile signal islransmH- 
ted via the telephone line to the conmrujnication oppo- 
site party identified by the destination telephone 
number. After the step S1 14. the current execution cycle 
of the program segment erxls. 

A step SI 15A transfers the image data of the fac- 
simile format from the storage unit 4 to a data compres- 
sor/expander 8A (see Fig. 24). The step S115A 
activates the data compressor/expander 8A so that the 
image data of the facsimile format is expanded by the 
device 8A into expansion-resultant binary image data 
(expansion-resultant bi4evel image data). Further, the 
step SI ISA transf^^the -expansion-resultant binary 
image data from the data compressor/expander 8A to 
the storage unit 4 before storing the expansion-f esultant 
binary image data into the storage unit 4. 

A step S115B subsequent toihe step S1 1 5A trans- 
fers the expansion-resuHant binary image data from the 
storage unit 4-to a printer 11 <see Fig. 24). The step 
S115B activates the printer 11 so that the expansion- 
resultant binary image data is visualized or printed out 
by the device 1 1 . After the st^ Si 1 SB, the current exe- 
cution cyde of the program segment ends. 
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Fifteenth Embodiment 

Fig. 28 shows a fifteenth embodiment of this inven- 
tion which IS similar to the embodiment of Figs. 24 and 
25 except for an additional arrangement described s 
hereinafter. 

Wrth reference to Fig. 28. an olectrontc mail system 
includes a CPU 1 . a BOM 2. a RAM 3. a storage unit 4, 
a format converter's, a scanner 6. an operation panel 
TF. a.data compressor/expander 8A, a LAN (local area io 
netwprt^ format converter 1 0. a 

iJi^^SS??^ -^2,>a character recognition 

f^^i^^lgpfrr^^ device 1 4, an audio conv 

^^§f^pre«^^ 16. a 

' fvir^^ 1 7. a nnodem 18. is 

^ind a world dock 19 which are electrically connected 
via aixis Itna The world dock 1 9 generates information 
of standard time in every country in the wortd. 

The CPU 1 operates in accordance with a program 
stored in the ROM 2. Fig. 29 is a flowchart of a segment 20 
of the program. With reference to Fig. 29. a first step 
S121 in the program segment decides whether or not 
information of the destination or the address of an e- 
mail to be transmitted has t>een irputted via the opera- 
tion panel 7R In the case where the information of the 2s 
destination of an e-mail to t>e transmitted has been 
inputted, the program advances from the step S121 to a 
step Sl22. -Othen«se. the pro-am repeats the step 
SI 21 . Thus, the step S121 waits the reception of do- 
nation irtformation. 30 

The step SI 22 sets desired time for e-mail trans- 
mission which is expressed according to standard time 
in a country having an e-mail destination. A step S123 
foltowing the step Si 22 decides whether or not the start 
button on the operation panel 7F tias been depressed. 35 
In the case where the start button on the operation 
panel 7F has been depressed, the program advaru^es 
from the-step S123 to a step S124. OthenA«se. the pro- 
gram repeats the step S123. Thus, the step S123 waits 
the depression of the start txrtton. 40 

The step S124 activates the scanner 6 so that an 
image of the surface of a document sheet in the scanner 
6 is converted by the scanner 6 into conresponding 
binary image data (corresponding bi-level image data). 
A ^ep S125A folfowing the step S124 transfers the 4S 
binary image data frcwn the scanner 6 to the data com- 
pressor/expander 8A, Then, the step S125A activates 
tfie data compressor/eoqpander 8A so that the i»nary 
image data is compressed t>yihe devfoe 8A into com- 
pression-resuttant magexteda of a given iacsinvlefor- so 
mat. Further, the ^step S125A transfers the 
compression-resuttant image data of the facsimile for- 
mat from the data compressor/expand®" 8 A to the stor- 
age unit 4 before storing the compression-resultant 
image data of the facsimile format info the storage imit 55 

4. 

A step S125B following the ^ep S125A transfers 
the compression-resultant image data of the facsimile 
format from the storage unit 4 to the format converter 5. 



492 A1 




In addition, the step S125B transfers the information of 
the e-mail destination to the format converter 5. The 
step S125B activates the format converter 5 so that the 
compression-resultant image data of the facsimile for- 
mat is converted by the device 5 into corresponding 
image data of the e-mail format. Further, the step 
S125B transfers the image data of the e-mail format 
from the format converter 5 to the storage unit 4 t>efore 
storing the image data of the e-mail format into the stor- 
age unit 4. 

A step S126 fdlowing the step S125B detects a 
destinatfon's country from the information of the -e-mail 
destinatfon. tt is well-known that an erxi part of informa- 
tion of an e-mail destinatfon irvlfoates the destinatfon's 
country. A step Si 27 subsequent to the step S126 
detects present time in the destination's country by 
referring to the informatfon generated by the wortd dock 
19. The step S127 deddes whether or not the present 
time in the destination's country reaches the desired 
time for e-mail transmission. This decision is to wait a 
momerrt at which the p>resent time in the destination's 
country reaches the desired tme for e-mail transmis- 
sion. In the case where the present time in the destina- 
tion's country reaches the desired time for e-mail 
transmissfon, the step S127 transfers the image data of 
the e-mail formal from the storage unit 4 to the LAN con- 
troller 9. The step Si 27 activates the LAN controller 9 
so that the image data of the e-mail format is further 
transfened from the LAN controller 9 to an e-mail com- 
puter 9A. The image data of the e-mail format, that is, 
an e-mail, is transmitted from the e-mail comcHiterGA to 
the destination via an e-mail network 98. After the step 
SI 27. the cun^ent executfon cyde of the program seg- 
ment ends. 

Sixteenth E mbodiment 

A sixteenth embodiment of this inventfon is similar 
to the emtxxliment of Figs. 24 and 25 except for design 
changes descrfoed hereirtafter. 

Rg. 30 is a f towchart of a segment of a program for 
controlling a CPU 1 (see Rg. 24) in the sixteenth 
embodiment. With refermce to Fig. 30. a first step Si 31 
in the program segment decides whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 
wait the reception of inrage data of the e-niailfornriai <n 
the case where image data of the e-niail format has 
been received, the step 8131 transfers the received 
image data of the 'e-mail format to a storage ur^ 4 (see 
Rg. 24). The step S131 controls the storage unit 4 so 
that the received image data of the «-mail format is 
stored into the storage unit 4. 

A step S132 folfowing the step S131 transfers the 
received image data of the e-mail format from ttie stor- 
age unit 4 to an inverse format converter 10 (see Rg. 
24). The step Si 32 activates the inverse format con- 
verter 10 so that the received image data of the e-mail 
format is converted by the device 10 into corresponding 
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image data of the facsimile^Wriat. 

A step S133 subsequent to the step S132 transfers 
the image data of the facsimile format from the inverse 
format converter 10 to the storage unit 4. and then stor- 
ing the image data of the facsimile format into a box 
which is provided in the storage unit 4 for the related 
destination, ft should be noted that boxes provided in 
the storage unit 4 have a correspondence relation with 
pre/iousiy-regtstered owner's ID infornnation and previ- 
ously-regpstered pass words. 

A step S134 foUowing Ihe step S133 decides 
whether.t>r not owner's ID information arvJ a pass word 
are irputted. -This dec^ion is to wait the reception d 
owners ID inf orma tion and ^ i»S8 imrd. In the case 
where ownerW ID information and a pass word are 
irputted. the step SI 34 deddes whether or not the 
inputted owner's ID information and the inputted pass 
word are acceptatsla In the case where the inputted 
owner's ID information and the inputted pass word are 
acceptable, the program advances from the step S134 
to a step S135A, Otherwise, the current execution cyde 
of the program segment ends. 

The step S135A reads out the image data of the 
facsimile format from the box in the storage unit 4 which 
corresponds to the inputted owner's ID information and 
the inputted pass word. The step S135A transfers the 
image data of the facsimile fomruct to a data compres- 
sor/expander 8A (see Fig. 24). The step S135A acti- 
vates the data compressor/exparxfer 8A so that the 
image data of the facsimile format is expanded by the 
device 8A into expansion-resultant birmry image data 
(expansion-resultant t>i-level image data). 

A step S1 35B &ut>sequent to the step S135A trans- 
fers the expansion-resultant imary image data from the 
data compressor/expander 8A to a printer 1 1 (see Fig. 
24). The step S135B activates the printer 1 1 so that the 
expansion-resultam binary image data is visualized or 
printed out by the device 1 1 . After the step S135B. the 
current execution cyde of the program segment ends. 

Seventeen th Embodiment 

A seventeenth embodiment of this invention is sim- 
itar to the embodiment of Ftg. 30 except for design 
changes described hereinafter. In the seventeenth 
embodiment, the step S134 is onrvtted from the program 
segment of Fig. 30. and the step 8133 is immediately 
fdlowed by the step 81 35 A. 

Infonnation of owner's cover sheet is previously 
registered in a related box of a storage unit 4 (see Fig. 
24). The registration is implenDented by using a scanner 
6 (see Rg. 24) or.transnvtting an e-mail having a cover- 
sheet registering instruction. 

In the seventeenth embodiment the step 8135B is 
modified so that information of a cover sheet is read out 
from the storage unit 4. and the information of the cover 
sheet is added to expansion-resultant t>inary image 
data. Accordingly, a combination of the cover-sheet 
information and the expansion-r^ultant binary image 



data is visualHi or printed out by a printer 1 1 (see Fig. 
^24). 

Eighteenth Embodiment 

5 

An eighteenth embodimert of this invention is simi- 
lar to the embodtmerrt of Figs. 24 and 25 except for 
design changes described hereinafter. 

Rg. 31 ailowchart of a segment of a program for 

10 controlling a CPU 1 (see F^. 24) in the eighteenth 
embodiment Wrth reference to Fig. 31. a first step 8141 
in the pro-am segment decides whether or not image 
data of the e-mail iomtat (an e-mail) has t>een received 
t>y a LAN controller 9 (see Fig. 24). This decision is to 

1$ wait the reception of image data of the e-mail format In 
the case where image data of the e-mail format has 
been received, the step 8141 transfers ftte received 
in^ge data of the e-mail format to a storage unit 4 (see 
Fig. 24). The step 8141 controls the storage unit 4 so 

20 that the received image data of the e-mail format is 
stored into the storage unit 4. 

A step 8142 following the step 8141 transfers the 
received image data of the e-mail format from the stor- 
age unit 4 to an inverse format converter 10 (see Fig. 

25 24). The step 8142 activates the inverse format con- 
verter 1 0 so that the received image data of the e-mail 
format is converted by the device 10 into corresponding 
image data of a given tacstrrtile format The step 8142 
transfers the image data of the facsimile format to the 

30 Storage unit 4 before storing the image data of the fac- 
sirnle format intoihe storage unit 4. 

A step S143A following the step 8142 transfers the 
image data of the facsimile format from the storage unit 
4 to a data compressor/expanderrSA (see Fig. 24). The 

35 Step 81 43 A activates the data compressor/expander 8A 
so that the image data of the facsimile forn^t is 
expanded by the device 8A into expansion-resultant 
binary image data (expansion-resultant bi-level image 
data). 

40 A step 8143B subsequent to the step 81 43 A trans- 
fers tfie expansion-resultant binary image data from the 
data compressor/expander 8A to a printer 1 1 (see Fig. 
24). The step S143B activates tiie printer 1 1 so that the 
expansion-resuttant binary image data is visualized or 

45 printedoutby the device 11. 

A step 8144 detects in for ma tion of the address of a 
sender related to the received e-mail. The step 1 44 con- 
trols a LAN controtier 9 (see Rg. 24) so that a respon- 
sive e-mail c mi fimw ig e-msul reception will be 

50 trartsmitted to the sender address. After the step 81 44. 
the cunent executim cyde of the program segment 
ervjs. 
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Nineteenth Embodiment 

A nineteenth embodiment of this invention is sintilar 
to the errtxxJinrtent of Figs. 24 and 25 except for design 
changes described hereinafter. 

Fig. 32 is a flowchart of a segment of a program for 
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controlling a CPU 1 (see Fig. 24) in the nineteenth 
embodiment. With reference to Fig. 32. a first step Si 51 
in the program segment decides whether or not image 
data of the e-mail format (an e-mail) has been received 
by a LAN controller 9 (see Fig. 24). This decision is to 5 
wart the reception of image data of the e-mail format. In 
the case where image data of the e-mail format has 
been received, the step Si 51 transfers the received 
image data of the e-mail format to a storage unrt 4 (see 
Fig, 24),0p^ jBit0Q S151 controls the storage unit 4 so w 
^.^.^^'f^ image data xjH the e-mail format is 
®^Sl^^?® 6tCMBigeunit 4.v , 

t ^^^e^^W^^ trar^sfers the 

^^^^^J^S^S^'^ "^ e-mail format from the stor- 
— age4initl4'to^^ converter 10 (see Fig. 15 

24).jlbe:«lep S152 activates the inv^se format con- 
v erter lO»ihat the received image data of the e-mail 
foonatis converted i>yr the daoce 10 into corresponding 
image data of a given facsimile format. 

A step S153A following the step Si 52 adds recep- 20 
tion ID infomiation to the image data of the facsirrale for- 
mat. The reception ID infonmation is generated on the 
basts of date and time mique for one year. The step 
SI 53A transfers the ID-added image data of the facsim- 
ile format to the storage unit 4 before storing the ID- 25 
added image data of the facsimile format into the stor- 
age unit 4. . 

A st^ SI 53B subsequent to the step Si 53A trans- 
fers the ID-added image dafa of the facsimile format 
from the storage unit 4 to a data compressor/expander 30 
8A (see Fig. 24). The step S153B activates the data 
compressor/expander 8A so that the ID-added image 
data of theOacsimile format is expanded by the device 
8A into^expansion-resuftant binary image data (expan- 
sion-resultant bi-level image data). 35 

A step Si 53C subsequent to the step SI 53B trans- 
fers thecexpansion-resultant binary image data from the 
data compressor/expander 8A to a printer 1 1 (see Fig. 
24). The step SI 53C activates the printer 1 1 so that the 
expansfonnesiAant t>inary image data is visualized or 40 
printed out by the device 1 1 . 

A step S154 following the step S153C decides 
whetfier or not information equal to the reception ID 
infomiation added to the image data has been inputted 
via an op&ation panel 7F (see Fig. 24). In the case 45 
where such reception ID information has been inputted, 
the program advances from the step 8154 to a step 
S1S5. Oth^wise, the program repeats the step S154. 
Thus, the step 8154 waits the reception of the ID infor- 
mation. 

The step 8155 analyzes the header of the received 
e-mail, and thereby detects a sender address corre- 
sponding to ttie reception ID information. The step Si 55 
controls a LAN controller 9 (see Fig. 24) so that a 
responsive confirmation e-nrail will be transmrtled to the 55 
sender address. After the step Si 55, the current execu- 
tion cyde of the program segment ends. 



Twentieth Embodimf jin^ 

A twentieth embodiment of this invention is similar 
to the embodiment of Figs. 24 and 25 except for design 
changes descrtt>ed hereinafter. 

Rg. 33 is a flowchart of a segment of a program for 
controlling a CPU 1 (see Fig. 24) in the twentieth 
embodiment With reference to Fig. 33. a first step 8161 
in the program segment decides whether or not charac- 
ter code data in an e-mail has been received by a LAN 
controller 9 (see Fig. 24). This deciston is to wait the 
reception of character code data in an e-mail in the 
case where the character code data in the e-mail has 
been received, the program advances from the step 
8161 10 a step 8162. The step 8162 analyzes the 
"From" part of the header of the e-mail to detect a 
sender address. 

A step 8163 following the step 8162 decides 
whether or not the sender address agrees with a given 
address assigned to the present e-mail system. When 
the sender address agrees with the given address, the 
program advances from the step 8163 to a step 8164. 
Othenwise. the program advances from the step 8163 to 
a step 8165. 

The step 8164 transfers a signal indicative of a 
transmission failure to a printer 1 1 (see Fig. 24). The 
step 8164 activates the printer 11 so that the transntis- 
sion failure signal is visualized or printed out by the 
device 11. After the step 8164. ihe cunent execution 
cyde of the program segment ends. 

The step 81 65 converts character code data in the 
text into corresponding image dafa. A step 8166 follow- 
ing the step S165 transfers the image xfata to the printer 
11. The step 8166 activates the printer 11 so that the 
image data is visualized or printed CHJt by the device 1 1 . 
After the step SI66. the current execution cyde of the 
program segment ends. 

Other Emh9riim^ 

Any one of the second embocfiment to the twentieth 
embodinrwnt may be modified to indicate character 
code dafa in the received e-mail on a dispfay such as a 
CRT The CFTT may also be used to indicate moving pic- 
tures. 

At least two of the first embodiment to the twentieth 
embodiment nnay be combined into an electronic mail 
system 

Cfaims 

1. Anelectronic nDail system connected to a network, 
comprising: 

means for converting an image of a document 
surface into coaesponding document image 
data: 

means for compressing the document image 
data into compression-resultent image data; 
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means for converffflg the compression-resuit- 
ant image data into corresponding Image data 
of a given electrorric-nnail format; 
means for receiving information of an eiec- 
tronic-mail destination address; and 
means for transmitting the image data of the 
electronic-mail format toward the electronic- 
mail destination acklress via the network. 

2. The electronic mail system of claim 1 , further com- 
prising: 

means for receiving image data in an electronic 
mail; 

means for converting the received image data 
into corresponding received image data of a 
given facsinrRle format; 

means for expanding the received image data 
of the facsimile format irrto expansion-resuttant 
image data; and 

means for printing the expansion-resultartt 
image data. 

3. The electronic mail system of daim 1 . further com- 
prising means for transmitting character code data 
t>y an electronic mail. 

4. The electronic mail system of daim 1 , wherein the 
destination-address receiving means conrprises 
means for recognizing an electronic-mail destina- 
tion address in a given position of the image data. 

5. The electronic mail system of daim 1 , further conv 
' prising means for receiving information of an elec- 
" tronic-mail sender address as information of an 

electronic-mail source address, and means for. in 
cases where a transmission failure occurs, inform- 
ing the electronic-mail source address of the trans- 
mission failure. 

6. The electronic mail system of daim 1 , further com- 
prising means for receiving audio data, means for 
integrating the audio data and the image data into 
integration-resultant data, and means for transmit- 
ting the integration-resultant data as a single elec- 
tronic mail. 

7. The electronic n^l system of daim 1 , further com- 
prising mearts for receiving nrxwing-picture data, 
mearis for integrating the moving-picture data and 
ihe image data into integration-resuttant data, and 
means for U ai t smi t ti ng the integration-resultant 
data as a single electronic mail. 

8. The electronic mail system of daim 3. further com- 
prising means for analyzing a character sequence 
in a given position of received character code data, 
and means for implementing a process in response 
to a result of said analyzing. 
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The elecfWnic mail system of daim 8. further com- 
prising means for. in cases where the analyzed 
character sequence indicates registration of a des- 
tination nr^ail address, registering sender ID infor- 
5 mation in a sutssequent character sequence and a 

plurality of destiriation mail addresses while provid- 
ing a correspondence relation t>etween the sender 
ID information and the destination mail addresses, 
and mear« lor. in cases where send^ ID informa- 
10 tion is received during nnail trartsmisston and the 
sender ID information is equal to the registered 
sender ID i nfo r mati on, indicatir^ the corresponding 
destination mail addresses and selecting a neces- 
sary destination from among the destination rr^l 
T5 addresses. 

1 0. The electronic inail systmi of daim 8, further com- 
prisirtg means for, in cases where the analyzed 
character sequence indicates registration of a 
20 source mail address, registering sender ID infornria- 
tion in a sut>sequent chcu-acter sequence and a 
source mail address while providing a correspond- 
ence relation t>etween the serxjer ID information 
and the source mail address, and means for. in 
25 cases where sender ID information is received dur- 
ing mail transmission andthe sender ID information 
is equal to the registered serxier ID infonnation. 
receiving the corresponding source mail address as 
a source. 



30 

11. The electronic mail system of daim 9.iurther com- 
prising means for. in cases where sender ID infor- 
mation is received during mail transrrossion and the 
sender ID information is -equal to the registered 

35 sender ID information, writing information of a 
source mail address conesponding to the sender 
ID information into a header of a mail as a source. 

12. The electronic mail system of daim 2. further.com- 
40 prising means for providing a connection to a tele- 
phone line. BPti means for selectively transmitting 
the image data via the connection to the telephone 
line according to a facsinrele procedure or via the 
network according to an electronic-mail procedure. 

45 

1 3. The electronic mail system of daim 1 2. further com- 
prising means for analyzing a character sequence 
in a given position of character code data in a 
received electronic mail, means for. in cases where 

50 the analyzed character sequence indicates wait tor 
facsinvle data reception, recognizing a rKStice elec- 
tronic-mail address in a subsequent character 
sequence, means for. in cases wh^e image data is 
received via the connection to the telephone line 
55 according to a facsimile procedure after the notice 
electronic-mail address is recognized, transmitting 
an electronic mail representative of a reception 
notice to the notice electironic-mall address. 
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14. The electronic mail system of claim 12. further com- 
prising means for analyzing a first character 
sequence in a given position of a header of image 
data in a received electronic mail, means for. in 
cases where the analyzed character sequence indi- 5 
cates facsimile transnrassion. recognizing a secorxj 
character sequence in a given position of the 
header except the first character sequence as a 
facsimile number, and means for transmitting the 
receivedmnage data toward the facsimile nunrt>er io 
A^4he;com6ction .to the telephone line acoorcfing 
toaiacsMleprocedura:: 

1 5. 1?^ elebtronic mail system of claim 1 , further com- 
prising means for identifying a country having a is 
destination in response to the destination address, 
means^for generating information of starxterd time 

in the identified country, and means for transmitting 
the image data as an electronic mail at a desired 
moment expressed according to the standard time 20 
in the identified country. 

1 6. The electronic mail system of claim 2. further com- 
prising means for registering a plurality of elec- 
tronic-mail addresses, means for storing and 25 
managing image data transmitted by an electronic 
mail for each of the electronic^mail addresses, 
means for setting pass words for the respective 
electronic-mail addresses, and means for output- 
ting the stored image data when a related pass 30 
word is received. 
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for outputting information of a first page of the 
image data. 

21. The electronic mail system of claim 1 . further com- 
prising means for receiving character code data by 
an electronic mail. 



17. Theelectronictnailsystemofdaim 16, further com- 
prising means for generating information of a cover 
sheet for each of the electronic-mail addresses. 35 
and means for adding the information of the cover 
sheet and outputting a resultant of said adding. 

18. The electronic mail system of claim 2. further com- 
prising means for, in cases where a first electrorvc 40 
mail is received, transmitting a second electronic 
mail representative of reception of the first elec- 
tronic mail to a sender electronic-mail address 
related to the first electronic nr^ail. 

45 

19. The electronic mail system of daim 2, further com- 
prising means for writing reception ID infomwtton 
for each reoeived electronic mail, means for provid- 
ing a correspondence relation b^een . a sender 
electronic-mafl address related to the rec^ved so 
electronic mail ;and reception JD information. «nd 
means for. in cases where the reception ID informa- 
tion is received, transmitting a conformation elec- 
tronic mail to the sender electronic-mail address. 

55 

20. The electronic mail system of claim 2, further com- 
prising means for. in cases where transmission of a 
received electronic mail fails, printing information 
representative of a transmission failure, and means 
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